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THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
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- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 
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earned patent term adjustment. See 37 CFR 1.704(b). 
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1 )[3 Responsive to communication(s) filed on 13 June 2005 . 
2a)^ This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 1 1 , 453 O.G. 213. 
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4a) Of the above claim(s) is/are withdrawn from consideration. 
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6) ^ Claim(s) 1-13 is/are rejected. 
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8) Q Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
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DETAILED ACTION 

1. This action is responsive to communications: Amendment filed 06/13/2005 to the 
original application filed 03/06/2000. 

2. Claims 1-13 are currently pending in this application. Claim 1 is independent claim. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 102 of this title, if 
the differences between the subject matter sought to be patented and the prior art are such that the subject matter as a whole would 
have been obvious at the time the invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of the claims under 35 U.S.C. 103(a), the examiner 
presumes that the subject matter of the various claims was commonly owned at the time any inventions covered therein were made 
absent any evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1 .56 to point out the inventor and invention 
dates of each claim that was not commonly owned at the time a later invention was made in order for the examiner to consider the 
applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (0 or (g) prior art under 35 U.S.C. 103(a). 

Claims 1-13 remain rejected under 35 U.S.C. 103(a) as being unpatentable over Yeo et 
al. "Rapid Scene Analysis on Compressed Video", 12/1995 in view of Ganser et al. 
(U.S. 4,953,106 - issued 08/1990). 



As to independent claim 1: 

a. Yeo teaches: 
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(i) segmenting the multimedia content to extract objects (e.g., segment the 
videos into temporal 'shots'; page 533, left col., T d para.)\ 

(ii) extracting (extract) and associating (indexing) features (key informations) 
of the objects to produce content entities {page 533, left col.)\ and 

(iii) measuring attributes of each content entity (image attributes such as color 
histogram can be precomputed; page 543, sec. vii). 

b. Yeo does not specifically teach: 

(i) coding the content entities to produce directed acyclic graphs of the 
content entities, each directed acyclic graph representing a particular 
interpretation of the multimedia content; and 

(ii) assigning the measured attributes to each corresponding content entity in 
the directed acyclic graphs to rank order the multimedia content. 

c. Ganser teaches: 

(i) coding the content entities to produce directed acyclic graphs of the 
content entities (drawing directed graphs that provide appropriately 
interconnected labeled blocks or nodes with reduced edge crossings and 
improved picture clarity from a user-supplied block or node 
interconnection listing; coll, lines 61-65), each directed acyclic graph 
representing a particular interpretation of the multimedia content (the 
graph description is used to construct an input graph of attributed nodes 
and edges. Such first step, hereinafter termed the 'parser ', translates the 
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edge list descriptions into appropriate internal presentations in memory of 
processor 11; col.4, lines 3-10); and 
(ii) assigning the measured attributes to each corresponding content entity in 
the directed acyclic graphs to rank order the multimedia content (finds an 
optimal rank assignment for the nodes. An optimal rank assignment 
assigns integer ranks to nodes such that the sum of the "costs " of edges is 
minimized; col.4, lines 40-44). 
d. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Ganser in the system of Yeo 
because Ganser' s teaching would have provided the capability for allowing the 
best rankings of nodes, producing a satisfactory reduction in the edge crossings 
within a reasonable period of time, and improve the final placement of nodes in 
the drawing after edge crossings are minimized, other than straightening edges. 
As to dependent claim 2: 

Yeo teaches the measured attributes include intensity attributes (page 543, section vii). 
As to dependent claim 3: 

Yeo teaches the measure attributes include direction attributes (page 543, section vii). 
As to dependent claim 4: 

Yeo teaches the measured attributes include spatial attributes (page 536, section A). 
As to dependent claim 5: 

Yeo teaches the measured attributes include temporal attributes (temporal segmentation; 
page 535, section iv). 
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As to dependent claim 6: 

a. Ganser teaches the measured attributes are arranged in an increasing rank order 
(the lowest rank to the highest rank; col.6, lines 59-61 & col.8, lines 3-31). 

b. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Ganser in the system of Yeo 
because Ganser' s teaching would have provided the capability for ensuring the 
initial node ordering of a directed tree has no crossings. 

As to dependent claim 7: 

a. Ganser teaches the measured attributes are arranged in an decreasing rank order 
(the highest rank to the lowest rank; col.6, lines 59-61 & col8 t lines 3-31), 

b. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Ganser in the system of Yeo 
because Ganser' s teaching would have provided the capability for ensuring the 
initial node ordering of a directed tree has no crossings. 

As to dependent claim 8: 

a. Ganser teaches traversing the multimedia content according to the directed 
acyclic graph (col 6, line 59-col 7, line 1 & col 8, lines 23-31) and the measured 
attributes assigned to the content entities (finds an optimal rank assignment for 
the nodes. An optimal rank assignment assigns integer ranks to nodes such that 
the sum of the "costs " of edges is minimized; col4, lines 40-44). 

b. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Ganser in the system of Yeo 



Application/Control Number: 09/518,937 Page 6 

Art Unit: 2176 

because Ganser's teaching would have provided the capability for allowing the 
best rankings of nodes, producing a satisfactory reduction in the edge crossings 
within a reasonable period of time, and improve the final placement of nodes in 
the drawing after edge crossings are minimized, other than straightening edges. 
As to dependent claim 9: 

a. Ganser teaches summarizing the multimedia content according to the directed 
acyclic graph and the measured attributes assigned to the content entities (finds 
an optimal rank assignment for the nodes. An optimal rank assignment assigns 
integer ranks to nodes such that the sum of the "costs " of edges is minimized; 
colA, lines 40-44). 

b. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Ganser in the system of Yeo 
because Ganser' s teaching would have provided the capability for allowing the 
best rankings of nodes, producing a satisfactory reduction in the edge crossings 
within a reasonable period of time, and improve the final placement of nodes in 
the drawing after edge crossings are minimized, other than straightening edges. 

As to dependent claim 10: 

Yeo teaches the multimedia content is a three dimensional video sequence (video; page 
533; section Introduction). 
As to dependent claim 11: 
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a. Ganser teaches nodes of the directed acyclic graphs represent the content entities 
and edges represent breaks in the segmentation, and the measured attributes are 
associated with the corresponding edges (col.9, line 1 -col. 10, line 14). 

b. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Ganser in the system of Yeo 
because Ganser' s teaching would have provided the capability for allowing the 
best rankings of nodes, producing a satisfactory reduction in the edge crossings 
within a reasonable period of time, and improve the final placement of nodes in 
the drawing after edge crossings are minimized, other than straightening edges. 

As to dependent claim 12: 

a. Ganser teaches at least one secondary content entity is associated with a 
particular content entity, and wherein the secondary content entity is selected 
during the traversing (col. 6, line 59-col. 7, line 1 & col.8, lines 3-21). 

b. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Ganser in the system of Yeo 

, because Ganser' s teaching would have provided the capability for allowing the 
best rankings of nodes, producing a satisfactory reduction in the edge crossings 
within a reasonable period of time, and improve the final placement of nodes in 
the drawing after edge crossings are minimized, other than straightening edges. 
As to dependent claim 13: 

a. Ganser teaches a summary of the multimedia is a selected permutation of the 
content entities according to the associated ranks (col.4 f lines. 1-51). 
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b. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Ganser in the system of Yeo 
because Ganser' s teaching would have provided the capability for allowing the 
best rankings of nodes, producing a satisfactory reduction in the edge crossings 
within a reasonable period of time, and improve the final placement of nodes in 
the drawing after edge crossings are minimized, other than straightening edges. 

Response to Arguments 

4. Applicant's arguments. filed 06/13/2005 have been fully considered but they are not 
persuasive. 

Applicant "requested to specifically point out which words mean extracting and 
associating of the objects to produce content entities'' (Remarks, page 4, 1 st para.) 
In response, Yeo discloses extracting (extract) and associating (indexing) features (key 
informations) of the objects to produce content entities (page 533, left col.). 

Applicant argues that Yeo does not teach content entities. (Remarks, page 4, 2 nd para.) 

In response, Yeo does teach content entities (image attributes; page 543, sec. vii). 
The scope of the claimed "content entities" clearly transcends the more narrow scope that 
Applicant attempts to impute through argument. Claimed subject matter, not the 
specification is the measure of the invention. Limitations in the specification cannot be 
read into the claims for the purpose of avoiding the prior art, In re Self, 213 USPQ 1 
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(CCPA 1982), In re Priest, 199 USPQ 1 1 (1978). The recited "content entities" is clearly 
subject to a broad interpretation as detailed in the rejections maintained above. The 
Examiner has a duty and responsibility to the public and to Applicant to interpret the 
claims as broadly as reasonably possible during prosecution. In re Prater, 415 F.2d 1 393, 
1404-05, 162 USPQ 541, 550-51 (CCPA 1969). 

Applicant argues that Yeo never describe measuring attributes of content entities derived 
from extracted and associated features of the objects extracted from the multimedia 
content (Remarks, page 5, last para.) 

In response, Applicant is reminded that claimed subject matter, not the specification is 
the measure of the invention. Limitations in the specification cannot be read into the 
claims for the purpose of avoiding the prior art. See In re Self 213 USPQ 1,5 (CCPA 
1982); In re Priest, 199 USPQ 11,15 (CCPA 1978). Yeo does meet measuring attributes 
of each content entity (image attributes such as color histogram can be precomputed; 
page 543, sec. vii). 



Conclusion 



5. 



The prior art made of record and not relied upon is considered pertinent to applicant's 



disclosure. 



Katseff et al. 



U.S. Patent No. 5,822,537 



issued: Oct. 13, 1998 



Tan et al. 



U.S. Patent No. 4,356,902 



issued: Mar. 12, 2002 
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Garofalakis et al. U.S. Patent No. 6,665,732 issued: Dec. 16, 2003 

Vaithilingam et al. U.S. Publication 2002/0159640 Al Pub. Date: Oct. 31, 2002 

6. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the 
advisory action. In no event, however, will the statutory period for reply expire later than 
SIX MONTHS from the mailing date of this final action. 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Maikhanh Nguyen whose telephone number is (571) 272- 
4093. The examiner can normally be reached on Monday - Friday from 9:00am - 5:30 
pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather Herndon can be reached on (571) 272-4136. 
The fax phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 
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